Skip to main content

Focused Crawls

Internet Archive

Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.



rss RSS

Show sorted alphabetically
Show sorted alphabetically
SHOW DETAILS
up-solid down-solid
eye
Title
Date Archived
Creator
Top Domains
collection
184,753
ITEMS
2.3B
VIEWS
collection
eye 2.3B
A daily collection of thousands of the most popular web sites according to Alexa.com's top sites rankings .
Topics: daily, popular sites, Alexa
Top News
collection
131,947
ITEMS
934.3M
VIEWS
collection
eye 934.3M
A daily collection of hundreds of the world's top news sites.
Topics: daily, news
top_domains-00300
top_domains-00300
collection
5,099
ITEMS
59M
VIEWS
by Internet Archive
collection
eye 59M
top_domains-00900
top_domains-00900
collection
4,260
ITEMS
68.5M
VIEWS
by Internet Archive
collection
eye 68.5M
top_domains-00500
top_domains-00500
collection
3,358
ITEMS
83.5M
VIEWS
by Internet Archive
collection
eye 83.5M
top_domains-00600
top_domains-00600
collection
6,464
ITEMS
63.6M
VIEWS
by Internet Archive
collection
eye 63.6M
top_domains-01500
top_domains-01500
collection
2,744
ITEMS
48.7M
VIEWS
by Internet Archive
collection
eye 48.7M
top_domains-02500
top_domains-02500
collection
2,952
ITEMS
41.8M
VIEWS
by Internet Archive
collection
eye 41.8M
top_domains-00250
top_domains-00250
collection
2,116
ITEMS
55.8M
VIEWS
by Internet Archive
collection
eye 55.8M
top_domains-00800
top_domains-00800
collection
7,426
ITEMS
52.6M
VIEWS
by Internet Archive
collection
eye 52.6M
top_domains-00350
top_domains-00350
collection
2,158
ITEMS
53.5M
VIEWS
by Internet Archive
collection
eye 53.5M
nytimes.com
nytimes.com
collection
1,250
ITEMS
27.3M
VIEWS
by http://nytimes.com
collection
eye 27.3M
yahoo.com
yahoo.com
collection
1,374
ITEMS
41.3M
VIEWS
collection
eye 41.3M
nbcnews.com
nbcnews.com
collection
965
ITEMS
28.8M
VIEWS
by nbcnews.com
collection
eye 28.8M
taringa.net
taringa.net
collection
1,064
ITEMS
26.3M
VIEWS
by taringa.net
collection
eye 26.3M
top_domains-00450
top_domains-00450
collection
2,941
ITEMS
42.4M
VIEWS
by Internet Archive
collection
eye 42.4M
top_domains-00700
top_domains-00700
collection
1,609
ITEMS
44.5M
VIEWS
by Internet Archive
collection
eye 44.5M
top_domains-04500
top_domains-04500
collection
1,903
ITEMS
29.7M
VIEWS
by Internet Archive
collection
eye 29.7M
top_domains-02750
top_domains-02750
collection
1,944
ITEMS
39.9M
VIEWS
by Internet Archive
collection
eye 39.9M
top_domains-07500
top_domains-07500
collection
2,425
ITEMS
37.4M
VIEWS
by Internet Archive
collection
eye 37.4M
top_domains-02000
top_domains-02000
collection
2,343
ITEMS
37.1M
VIEWS
by Internet Archive
collection
eye 37.1M
top_domains-00400
top_domains-00400
collection
2,281
ITEMS
40.3M
VIEWS
by Internet Archive
collection
eye 40.3M
edgi monitor
edgi monitor
collection
2,658
ITEMS
24.1M
VIEWS
collection
eye 24.1M
worldpress.org
worldpress.org
collection
468
ITEMS
38.3M
VIEWS
by http://worldpress.org/
collection
eye 38.3M
top_domains-03000
top_domains-03000
collection
1,890
ITEMS
29M
VIEWS
by Internet Archive
collection
eye 29M
top_domains-09500
top_domains-09500
collection
3,751
ITEMS
32.4M
VIEWS
by Internet Archive
collection
eye 32.4M
buzzfeed.com
buzzfeed.com
collection
2,198
ITEMS
22M
VIEWS
by buzzfeed.com
collection
eye 22M
top_domains-04000
top_domains-04000
collection
2,575
ITEMS
29.7M
VIEWS
by Internet Archive
collection
eye 29.7M
top_domains-06000
top_domains-06000
collection
3,127
ITEMS
27.3M
VIEWS
by Internet Archive
collection
eye 27.3M
themeforest.net
themeforest.net
collection
522
ITEMS
27.9M
VIEWS
by themeforest.net
collection
eye 27.9M
top_domains-03750
top_domains-03750
collection
1,798
ITEMS
23.2M
VIEWS
by Internet Archive
collection
eye 23.2M
welt.de
welt.de
collection
1,666
ITEMS
17.5M
VIEWS
by http://welt.de/
collection
eye 17.5M
foxnews.com
foxnews.com
collection
1,102
ITEMS
20.7M
VIEWS
by http://foxnews.com
collection
eye 20.7M
top_domains-08000
top_domains-08000
collection
1,386
ITEMS
30.2M
VIEWS
by Internet Archive
collection
eye 30.2M
top_domains-08750
top_domains-08750
collection
1,954
ITEMS
28.3M
VIEWS
by Internet Archive
collection
eye 28.3M
top_domains-01000
top_domains-01000
collection
2,848
ITEMS
32.8M
VIEWS
by Internet Archive
collection
eye 32.8M
top_domains-04250
top_domains-04250
collection
2,191
ITEMS
28.5M
VIEWS
by Internet Archive
collection
eye 28.5M
time.com
time.com
collection
652
ITEMS
28.5M
VIEWS
by http://time.com
collection
eye 28.5M
top_domains-02250
top_domains-02250
collection
2,405
ITEMS
41.3M
VIEWS
by Internet Archive
collection
eye 41.3M
top_domains-04750
top_domains-04750
collection
1,544
ITEMS
24.2M
VIEWS
by Internet Archive
collection
eye 24.2M
top_domains-09000
top_domains-09000
collection
2,819
ITEMS
25.8M
VIEWS
by Internet Archive
collection
eye 25.8M
top_domains-05500
top_domains-05500
collection
6,820
ITEMS
23.7M
VIEWS
by Internet Archive
collection
eye 23.7M
top_domains-06250
top_domains-06250
collection
1,450
ITEMS
24.3M
VIEWS
by Internet Archive
collection
eye 24.3M
top_domains-03250
top_domains-03250
collection
994
ITEMS
21.3M
VIEWS
by Internet Archive
collection
eye 21.3M
top_domains-01750
top_domains-01750
collection
1,173
ITEMS
25.7M
VIEWS
by Internet Archive
collection
eye 25.7M
top_domains-08250
top_domains-08250
collection
3,317
ITEMS
21M
VIEWS
by Internet Archive
collection
eye 21M
top_domains-03500
top_domains-03500
collection
1,532
ITEMS
22M
VIEWS
by Internet Archive
collection
eye 22M
top_domains-01250
top_domains-01250
collection
990
ITEMS
19.9M
VIEWS
by Internet Archive
collection
eye 19.9M
top_domains-06500
top_domains-06500
collection
2,009
ITEMS
21.8M
VIEWS
by Internet Archive
collection
eye 21.8M
msnbc.msn.com
msnbc.msn.com
collection
6,963
ITEMS
14.8M
VIEWS
by http://msnbc.msn.com/
collection
eye 14.8M
abcnews.go.com
abcnews.go.com
collection
1,654
ITEMS
11.5M
VIEWS
by http://abcnews.go.com/
collection
eye 11.5M
top_domains-06750
top_domains-06750
collection
3,021
ITEMS
24.5M
VIEWS
by Internet Archive
collection
eye 24.5M
huffingtonpost.com
huffingtonpost.com
collection
5,820
ITEMS
24.5M
VIEWS
by http://huffingtonpost.com
collection
eye 24.5M
top_domains-05250
top_domains-05250
collection
3,279
ITEMS
24.3M
VIEWS
by Internet Archive
collection
eye 24.3M
top_domains-05750
top_domains-05750
collection
1,021
ITEMS
17.8M
VIEWS
by Internet Archive
collection
eye 17.8M
blogspot.in
blogspot.in
collection
222
ITEMS
15.1M
VIEWS
by blogspot.in
collection
eye 15.1M
sfgate.com
sfgate.com
collection
3,392
ITEMS
19.6M
VIEWS
by http://sfgate.com
collection
eye 19.6M
inn.co.il
inn.co.il
collection
614
ITEMS
17.3M
VIEWS
by http://inn.co.il/
collection
eye 17.3M
top_domains-07000
top_domains-07000
collection
1,932
ITEMS
23.2M
VIEWS
by Internet Archive
collection
eye 23.2M
top_domains-05000
top_domains-05000
collection
961
ITEMS
17.6M
VIEWS
by Internet Archive
collection
eye 17.6M
weather.com
weather.com
collection
690
ITEMS
11.1M
VIEWS
by http://weather.com/
collection
eye 11.1M
stumbleupon.com
stumbleupon.com
collection
170
ITEMS
24.6M
VIEWS
by http://stumbleupon.com
collection
eye 24.6M
salon.com
salon.com
collection
1,900
ITEMS
15.9M
VIEWS
by http://salon.com/
collection
eye 15.9M
top_domains-09250
top_domains-09250
collection
1,316
ITEMS
16.6M
VIEWS
by Internet Archive
collection
eye 16.6M
guardian.co.uk
guardian.co.uk
collection
1,195
ITEMS
15.5M
VIEWS
by http://guardian.co.uk/
collection
eye 15.5M
top_domains-09750
top_domains-09750
collection
1,452
ITEMS
16.1M
VIEWS
by Internet Archive
collection
eye 16.1M
latimes.com
latimes.com
collection
697
ITEMS
18.6M
VIEWS
by http://latimes.com
collection
eye 18.6M
top_domains-07750
top_domains-07750
collection
1,025
ITEMS
15.9M
VIEWS
by Internet Archive
collection
eye 15.9M
bild.de
bild.de
collection
2,864
ITEMS
6.9M
VIEWS
by http://bild.de/
collection
eye 6.9M
top_domains-07250
top_domains-07250
collection
1,999
ITEMS
16.4M
VIEWS
by Internet Archive
collection
eye 16.4M
chicagotribune.com
chicagotribune.com
collection
495
ITEMS
17.3M
VIEWS
by http://chicagotribune.com/
collection
eye 17.3M
reuters.com
reuters.com
collection
735
ITEMS
12.3M
VIEWS
by http://reuters.com
collection
eye 12.3M
vkontakte.ru
vkontakte.ru
collection
319
ITEMS
25.3M
VIEWS
by http://vkontakte.ru
collection
eye 25.3M
npr.org
npr.org
collection
3,642
ITEMS
12.6M
VIEWS
by http://npr.org/
collection
eye 12.6M
washingtonpost.com
washingtonpost.com
collection
1,126
ITEMS
14.5M
VIEWS
by http://washingtonpost.com/
collection
eye 14.5M